De-biasing the lasso with degrees-of-freedom adjustment

نویسندگان

چکیده

This paper studies schemes to de-bias the Lasso in sparse linear regression with Gaussian design where goal is estimate and construct confidence intervals for a low-dimensional projection of unknown coefficient vector preconceived direction a0. Our analysis reveals that previously analyzed propositions require modification order enjoy nominal coverage asymptotic efficiency full range level sparsity. takes form degrees-of-freedom adjustment accounts dimension model selected by Lasso. The (a) preserves success de-biasing methodologies regimes previous proposals were successful, (b) repairs provides produce spurious inferences provably fail achieve coverage. Hence our theoretical simulation results call implementation this methodologies. Let s0 denote number nonzero coefficients true ? population Gram matrix. unadjusted scheme may as soon s0?n2/3 if known. If unknown, grants contrast general a0 when s0logp n+min{s?logp n,???1 ?1 logp ? ??1/2 ?2 n}+min(s?,s0)logp n?0 s?=? ??1a0?0. dependence s0,s? ???1a0?1 optimal closes gap upper lower bounds. construction estimated score novel methodology handle dense directions Beyond adjustment, proof techniques yield sharp ?? error bound which independent interest.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Degrees of Freedom of the Group Lasso

This paper studies the sensitivity to the observations of the block/group Lasso solution to an overdetermined linear regression model. Such a regularization is known to promote sparsity patterns structured as nonoverlapping groups of coefficients. Our main contribution provides a local parameterization of the solution with respect to the observations. As a byproduct, we give an unbiased estimat...

متن کامل

Degrees of freedom in lasso problems

We derive the degrees of freedom of the lasso fit, placing no assumptions on the predictor matrix X. Like the well-known result of Zou et al. (2007), which gives the degrees of freedom of the lasso fit when X has full column rank, we express our result in terms of the active set of a lasso solution. We extend this result to cover the degrees of freedom of the generalized lasso fit for an arbitr...

متن کامل

On the “degrees of Freedom” of the Lasso By

We study the effective degrees of freedom of the lasso in the framework of Stein’s unbiased risk estimation (SURE). We show that the number of nonzero coefficients is an unbiased estimate for the degrees of freedom of the lasso—a conclusion that requires no special assumption on the predictors. In addition, the unbiased estimator is shown to be asymptotically consistent. With these results on h...

متن کامل

On the “Degrees of Freedom” of the Lasso

We study the degrees of freedom of the Lasso in the framework of Stein’s unbiased risk estimation (SURE). We show that the number of non-zero coefficients is an unbiased estimate for the degrees of freedom of the Lasso—a conclusion that requires no special assumption on the predictors. Our analysis also provides mathematical support for a related conjecture by Efron et al. (2004). As an applica...

متن کامل

De-biasing the Lasso: Optimal Sample Size for Gaussian Designs

Performing statistical inference in high-dimensional models is an outstanding challenge. A major source of difficulty is the absence of precise information on the distribution of high-dimensional regularized estimators. Here, we consider linear regression in the high-dimensional regime p n and the Lasso estimator. In this context, we would like to perform inference on a high-dimensional paramet...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Bernoulli

سال: 2022

ISSN: ['1573-9759', '1350-7265']

DOI: https://doi.org/10.3150/21-bej1348